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OPTIMAL  DELAY  ESTIMATION  IN  A  MULTIPLE 
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I.  Introduction 

The  estimation  of  time-of -arrival  differences  for  signals  from  a 
single  source  or  target  arriving  at  multiple  sensors  has  been  the  subject 
of  a  considerable  number  of  papers  in  recent  years.  These  time  delay 
differences,  or  simply  delays,  enable  target  localization  through  straight¬ 
forward  geometrical  considerations  when  the  signal  path  is  non-dispersive 
[1,2].  Although  target  location  is  the  primary  goal,  delay  estimation  is 
essentially  equivalent  as  there  is  a  one-one*,  although  nonlinear,  relation 
between  the  maximum-likelihood  (ML)  delay  vector  and  ML  location  vector. 

Essentially  all  of  the  results  of  available  literature  (except  [9]  have 
been  based  not  only  upon  the  geometric  and  non-dispersive  assumptions  stated 
above  but  also  upon  noise  spectra  which  are  independent  among  sensors.  The 
independent  noise  assumption  is  adequate  if  either  the  sensor  self -noise  is 
dominant  or  the  sensors  are  spatially  separated  sufficiently  such  that  the 
environmental  noise  is  indeed  independent  or  uncorrelated  among  sensors. 
However,  this  is  not  always  a  reasonable  assumption  and  the  effects  of 
spatially  correlated  noise  in  the  estimation  of  delays  and  delay  variances 
must  be  considered.  Thus  appropriate  analyses  are  herein  undertaken  to 
consider  correlated  noise  from  diffuse  sources.  Results  are  compared  to 
those  previously  published  for  independent  sensor  noises. 

Owsley  and  Fay  [11]  have  considered  correlated  noise  when  clustering 
sensors  and  optimizing  beamforraers.  The  comparable  optimization  of  delay 
estimation  has  not  previously  been  approached.  By  choosing  the  correlation 
parameter  p,  we  may  include  the  proportionality  of  correlated  turbulent 
boundary  layer  tow-noise  and  isotropic  sensor  noise. 

The  basic  approach  is  to  assume  that  complex  Fourier  coefficients  X^k) 
at  the  i—  sensor  for  the  k—  frequency  are  available,  having  been  obtained 
from  T-second  time  records,  where  T  is  long  with  respect  to  the  signal 
correlation  time. 


*  For  an  array  with  three  sensors  in  line  there  is  an  ambiguity  in  the 
sign  of  bearing  angle,  which  we  assume  may  be  solved  with  additional 
information. 


+  This  study  funded  under  office  of  Naval  Research,  contract  number 
N00014-82-K-0048. 
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The  time  data  records  are 

xi(t)  =  s(t-d^)  +  n^t),  i  =  1,2, ...M.  (1) 

where  d^  are  the  delays  from  the  reference  sensor  to  the  i—  sensor 
(d^  =  0),  s(t)  is  a  zero-mean,  Gaussian,  stationary  signal,  and  n^/t)  is  the 
additive  Gaussian  noise  at  the  i—  sensor. 


II.  Background 


The  problem  of  delay  vector  estimation  for  multiple  sensors  has  been 
studied  with  the  above  approach  in  original  papers  by  Hahn  and  Tretter  [3], 
Hahn  [4]  and  Schultheiss  [5].  Closely  following  their  presentations,  let 

T/2 


Xl'k>  ‘  T 


-T/2 


x^t)  exp{-jkcoot}dt,  k  =  1,2,. . .  ,K, 


(2) 


where  u j  =  2tt/T.  Define  a  vector  X  containing  the  above  MK  Fourier 
coefficients  as  elements.  If  S(<j)  and  N^to)  are  the  signal  and  noise 

spectra  at  the  i—  sensor,  the  probability  density  for  x  can  be  written 


where 


p(X)  =(TTMKn  det  R(k)  )-1  exp[-I  XT(k)R-1(k)X*(k) ] 
k=l  k=l 

X(k)  =  [X^k),  X2(k),  —  .X^k)]1 

T  T  T  T 

X  =  [XA (1) ;  X1 (2) , - .X1 (K) ] 1 

V (k)  =  [1,  exp(-jko)od2) , - ,exp(-jkmodM) ]T 

N(k)  =  [N^(k)],  an  MxM  matrix  of  noise 

cross-power  spectra 
R(k)  =  N(k)  +  S(k)  V*(k)VT(k) 


(3) 


and  where  *  superscript  denotes  complex  conjugation. 

In  order  to  obtain  the  ML  estimate  of  delays,  determinant  and  inverse 
theorems  of  use  are 

| R 1  -  |N  +  SV*VT|  -  l N] | I  +  N-1SV*VT|  =  | N ! (1  +  SVTN-1V*)  (4) 
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and 

if1  =  N_1  -  N-1  V*(VTN_1V*  +  1/S)-1  VTN_1  (5) 

-1  ik 

Defining  elements  of  N  as  N  ,  the  likelihood  function  of  the  delay  vector 
T 

D  =  (d2>  d  dM)  is,  using  (4), 

A  =  In  p(X)  =  -£n(iTMK)  -  £  An [  j  N  |  (1  +  SVTN-1V*)] 

B+ 


-  I  [xtn  1x*  -  xtn  1v*vtn~1x*] 

B+  vtn_1v*  +  1/S 

where  £  means  sum  over  positive  frequencies. 

B+ 

Hahn  and  Tretter  [3]  have  shown  that,  when  N  is  diagonal,  [N^ .N^,.  • .  .N^]  , 

the  Fisher  information  matrix  for  D  (FIM  =  -  <grad<grad  in  A>>  where  <•>  is 
expected  value)  is 

2 

FIM  =  y  2u>2  - - -  [(tr  N-1)N  _1-  N  _111TN  _1]  (7) 

B+  1  +  l  S/Nt  P  P  P 

where  N  1  is  N  1  with  the  first  row  and  column  removed.  The  Cramer-Rao 
P 

Matrix  bound  (CRMB)  for  the  delays  D  is  (FIM)  ^ .  The  ML  estimate  covariance 
is  known  to  asymptotically  approach  the  CRMB.  The  ML  estimate  for  small 

A 

delays  (D  Is  the  error  when  D  =  0)  and  independent  noise  is 


D  = 


-1  T 
-<C>  B  , 


(8) 


where 

<C>_1  =  FIM, 


(9) 


B  =  l  jw  - - -  1TN_1[XX  *T-X*X  T]N  “1, 

B+  1  +  P  P  P 


(10) 


and  x 

P 


is  X(k)  with  the  first  element  (X^(k))  removed. 


Hahn  and  Tretter  also  show  that  the  ML  D  estimate  can  be  implemented 
either  as  a  bearaformer  (ideally  in  real  time  only  when  the  are  propor¬ 
tional,  because  of  phase-matching  filter  criteria),  or  as  a  cross  correlator 


system  which  produces  the  M(M-l)/2  delay  estimates.  The  correlator  system 
has  cross-spectral  filters 
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S/NiN1 
1  +  l  s/nl 


i,  j  =  1,  2. 
i  t  j- 


M, 


The  error  covariance  matrix  for  the  pair-wise  delay  estimates  of  the  cor¬ 
relators  is  shown  by  Hahn  [4]  to  have  elements 


(11) 


var  (3  >  .  is.  |b  “2lpn  +  s(Nt  + 


( 


b^2i Fij i 2  sdw>2 


(12) 


covar (d^j «  d^)  =  0,  i. 


j ,  k,  l  all  distinct 


covar (d . . 


,du)  =  f 


i  ^  l 


(13) 


=  -  covar  (d^,  djli)  ,  j  t  l 

A 

It  is  emphasized  that  these  are  correlator  error  covariances  of  the  d . . 
and  not  ML  estimator  error  variances,  which  are  derived  herein. 

The  delays  having  covariance  matrix  defined  by  (12)  and  (13)  are  not 
the  M-l  delays  referred  to  a  single  sensor.  Hahn  and  Tretter  have  shown  how 
to  use  weighted  linear  combinations  of  the  M(M-l)/2  cross  correlation  delay 

A 

estimates,  d..,  to  form  an  estimate  for  D  =  (d.)  which  achieves  the  CRMB  of 
i  j  i 

(7). 


With  independent  noises  maximization  of  A  in  (6)  over  the  vector  D 
concentrates  on  the  second  term  in  the  second  summation,  because  other  terms 
are  not  dependent  on  the  d^.  This  is  not  generally  the  case,  and  an  analytical 
solution  is  not  available,  as  was  pointed  out  in  the  multipath  analysis 
given  by  Owsley  [6].  However,  the  generation  of  a  set  of  nonlinear  equations 
in  the  unknowns  d4j  may  be  obtained. 

In  the  next  section  ML  estimator  equations  for  the  M(M-l)/2  pairwise 
delays  are  derived.  Section  IV  produces  the  CRMB  for  these  delays.  Section 
V  considers  the  M-l  delays  dA  -  d  ,  and  Section  VI  derives  the  CRMB  for  the 
M-l  delays  d^  -  d^ . 


III.  Estimation  of  an  Independent  Subset  of  M(M-l)/2  Delays 
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This  section  will  determine  equations  for  ML  estimates  of  an  independent 


d^.  In  contrast  most  other  papers 


subset  of  the  M(M-l)/2  delays  d^  -  dfc 
referenced  find  ML  estimates  of  either  the  M-l  delays  (d^  -  d^) ,  2  <  i  <  M,  or 
other  parameters  such  as  range  and  bearing,  functions  of  which  the  d^  may  be 
written.  The  reason  for  our  choosing  the  d^  is  that  a-priori  information 
about  linear  relationships  among  them  may  subsequently  be  used  as  in  [10] 
to  improve  the  delay  estimates  d^  -  d^  or  any  other  subset. 

Because  we  will  find  equations  for  real  variables  and  real  unknowns, 
and  we  wish  to  be  able  to  show  effects  of  correlated  noise  on  various  parts 
of  the  formulations,  double  sums  throughout  the  paper  are  usually  broken  into 
several  pieces. 

Now  consider  the  two  summations  in  (6),  the  only  functions  of  D, 


A' 


-I  *n[(-l  +  S  l  NPP  +  S  H  NPqe"jli)(dp  “  V)|n|] 
b+  p  p  q^p 


NirNtk  -  O 


1 1 1  ^ i  i 

p  p  q*p 


(14) 


Thus  we  would  like  to  solve  for  the  d.,  which  maximizes 

ik 


-l  In  (1/S  +  I  I  »PV*“V 
B+  p  q 


+ 1  nix*n 

B+  m  n  m  n  r  t 


Nmr  Stn  e^rt 

l/s  +  H  »"V*“dp, 

p  q 


=  l  [-An(g)  + 
B+ 


T  -1  T  -1 
X  N  V*V  N  X* 


] 


(15) 


(16) 


where,  using  (15), 

g  =  1/S  +  VTN-Iv*  =  1/S  +  £nPP  +  2  l  l  (cos  cod  Re{NPq} 

P  p  q>p  pq 

+  sin  <od  I  {Npq}) 

pq  ® 

Differentiating  A’ '  with  respect  to  d^  (assuming  all  d^  independent)  gives 


(17) 


3A» 


3d 


ik 


I 

B+ 


_3(vV^V^I 

'  3dik 

g  - 

T  -1  T  -1  T  -1  T  -1  T  -1 

gX  N  3(V*V  )N  X*  -  X  N  V*V  N  X*  3(V  8  V) 


3d 


ik 


3d 


ik 


(18) 
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Setting  this  equal  to  zero  and  rearranging  gives 


I  {-jcyVV)  1  yt  -i 


B+  3d 


+X  N 


ik 


3(V*V  )  •  1 
dik  8 


V*VT  •  3(VTN~1V*> 


9  d  . , 

ik 


N_1X*}=0  (19) 


The  square-bracketed  terms  in  (19)  are  a  matrix  U(i,k)  =  (u^(i,k))  A  typical 

element  u  has  values  which  differ  according  to  whether  or  not  (m,n)  = 
mn 

(i,k)  or  (k,i).  Using 


and 


(V*V^)  =  e^mni 

m,n 


81  = 


(m,n) 

(m,n) 

(m,n) 

=  (i,k) 

=  (k,i) 

f  (i,k) , (k,i) 

ik) 

;2fci(-Re(N  }sin  (od^  +  Im{Nllc}cos  cod.^) 


(20a) 


(20b) 


(20c) 


in  u 


mn 


u 

mn 


(i,k)  give 

/ 

Jwd 


!  eJ  ik  (ju)  -  g^/g) 


e'jwdik  _  g  /g) 


-e^mn  g.  / g 


,  (m,n)  =  (i,k) 

,(m,n)=(k,i)  (21) 

,  (m,n)?i(i,k) ,  (k,i) 


Insertion  of  (21)  into  (19)  constitutes  M(M-l)/2  equations,  nonlinear,  to  be 
solved  for  the  d^.  This  is  pursued  further  in  Appendix  A  for  diffuse  noise. 
Note  that  only  M-l  delays  can  be  independent.  We  now  turn  our  attention 
to  the  CRMB. 
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IV.  The  Cramer-Rao  Bound  for  an  Independent  Subset  of  the  M(M-l)/2  Delay 
Estimates  of 


As  is  well  known,  maximum  likelihood  estimators  have  variances  which 

A 

approach  the  Cramer-Rao  bound.  The  variance  bounds  for  the  d  ^  are  the 
elements  in  the  diagonal  of 

CRMB  =  (FIM)"1  =  (-<grad  (grad  £n  A")T>)“1,  (22) 


wherein  FIM  is  the  Fisher  Information  Matrix,  grad  A''  is  a  row  vector 
whose  element  is  the  derivative  of  A''  with  respect  to  the  mn^-  delay 
(the  d^  here),  A"  is  the  expression  in  Eq.  (17),  and  <•>  denotes 
expectation.  The  outer  gradient  operator  creates  a  matrix  whose  elements 

a  3A*  * 

(-r-: — ).  We  have  already  found  the  inner  partial  —  the  result 


are 


3d  _  v3d., 
rt  ik 


is  Eq.  (19)  and  following.  For  any  M-l  independent  delays  the  following  applies. 
Taking  and  negating  the  second  partial  with  respect  to  d  gives 


3d  vad., 
rt  xk 


^-9A"  >>  =  _  V  r_r„  3  , 3VTN_1V*  n  3(VXN  1V*)  3(VTN-1V*)  , 

'^ik'  l{  - Sd— 


T  -1 


rT.,-1. 


+  h  U  xV1  4~  -  xV1  n-V 


3d 


rt 


3d 


ik 


3d 


ik 


3d 


rt 


T  -1  T  -1 
-  X  N  V*V  N  X* 


3  ,3vtn  2v* 


3d 


rt 


3d 


) 


ik 


jXvW)  xVi  i(mb 


3d 


ik 


3d 


rt 


T  -1 


+  -\kA-WV  ig‘.Cv-)H2g  jgVV)]}  . 

JL  ik  rt 


‘I  i  (- 

B+  8 


T  -1 

+  X  N 

32(V*VT)  g2  3(V*VT) 
g  3d, 


3d  3d., 
rt  ik 


ik 


3g 


I  _Il  V*,.T  1  d(V*VL)  2 

'  8  3d7t  V*V  -  g  81  +  "2  glg2V*V 


N_1X*} 


l  ^  (g,2  ~  g,g,/g)  -  7  l  XTN_^’BN~1X* 

B+  °  12  g  B+ 


(23) 
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where 


&1  =  -^S-  =  2oj(-Re{Nlk}sin^lik  +  Im{  N'lk}cosudik) 

lie 


g2  =  jd 


2u)(-Re{Nrt'}sin^xi  +  Im{Nl  L;cos.ui  ) 
rt  rt 


.rt 


rt 


(24) 

(25) 


/  \ 

and  B  =  b  ; is  found  using 
>.  mn 


.2 
L  £ 


0,  (r ,t)  ?f  (i,k) 


’12  3d  Jd., 
rt  lk 


(26) 


V  2-j"(-Re{N1  }cos  ..d  .k  -  ImlN1  }  s  in.jd  .  b),  <r ,  t )  =  (i  ,  k) 


ik 


r 

/o,  (r ,  t)  i  (i,k) 


2 

3  (V*V  1 )  , 

jd  jd  . , 

rt  ik  mn 


~x 


)  2  iud 

/  -w  eJ  ik,  (m,n)  =  (i,k) 


-uj2  e"’Ujdik,  (m,n)  =  (k,i)  4  ’  (i.k) 


,  (m,n)  ^  (k,  i)  , 
(i,k) 


(27) 


Then  b  has  the  following  values: 
mn 


(m,n)  =  (i,k) ,  (k,i) 


b. 


=  ^  4 


2  .  812 


2  jii  -  y(y  +  — ~  +  j«v)+  2  eJuX1ik 


ik  ( 


8  g 


(  2  S  a ) 


b  =  b  * 

ki  ik 


where  y  =  0  if  (or ,t)#(i,k)  ,y  =  1  if  (r,t) 
(m,n)  =  (r ,t) ,  (t,r)  ;  (r,t)#(i,k) 


b  =  ~h  ju>  +  2glg2 

^  g  2  > 


g 


b  =  b  * 
tr  rt 


(m,n)  t  (i,k),  (k,i),  (r,t),  (t,r) 

b  glg2  8,-,  ,  juid 

mn  <  -M  _1Z  )eJ  mn 

8  8 

b  =  b  * 
nm  mn 


(28b) 


(28c) 
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Using 


<X  X  *> 
r  t 


and  writing 


Se-^rt  +  N*  ,  r  ^  t 


rt 


vj  +  Nl 


,  r  =  t 


XTN_1  BN_1X*  =  l  b  E  | X  j 2  (N™11)2 
L  mm  1  m 1 
m 

+  2  Re{X  Nmm  T  X  *Nmq} 

m  q*n  q 

+  y  y  xx  *NpmNmq  ] 

p#m  q#m  P  q 

+  ^  ^  [Re{b  }  Re{G(m,n)} 
m  n>m  mn 

-  Im{b  }  Im{G(m,n)}  ] 


ran 


where 


C<„,n>  -  y  n"  l  x  V" 
p  q 


The  elements  of  the  F1M  are 

(FIM)rt,ik  =  (S12  “  S182/s) 

-  y  —  {  y  b  [  (s+n.  >  (n™11)2 

*• ,  g  L  mm  1 


B+  m 


+  2  J  ( (Scosu)d  +  ReEtT  })  ReEN^N1118} 

mn  mn 


mq 


mq 


■(-Ssinwd  +  Im{N  }  )  Im  {  N^N0^  }  ) 
mq  mq 


+  2  J  J  ( < Scosiod  +  Re{N*  })  Re{NpmNmq} 
X  q>p  Pq  Pq 

-(-Ssinuxi  +  Im{N  })  Im{NPmNmq}) 

pq  pq 

+  y  I  NPm  1 2  (Scosu)  d  +  Re{N*  })] 

H  *  1  pm  pm 

prm 

+  2  y  y  [Re{b  }  <  Re{G(m,n)}> 
u  _  mn 

m  n>m 

-  Im{b  )  <  Im{G (m,n) }  >]} 
mn 


(29) 


(30) 


(31) 


(32) 
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where 


;Re{C(m,n)}^  =  j  £  (Re{NpmNnq)  (S  cosuid  +  Re{N*  >) 


-Im{NP  N  q)  (-S  sinud  +  Im{N*  })) 

pq  pq 


<  Im{C(m,n)}''  = 


y  T  (Re{NpmNnq}(-Ssln-od  +  Im{N*  )) 
P  q  pq  pq 

+  ImfNPmNDq}(S  cosud  +  Re{N*  '.)) 

pq  pq 


Use  of  these  elements  in  the  F1M  is  restricted  for  inversion  to  the 
CRMB  to  M-l  independent  delays.  Further  examination  of  (32)  for  diffuse 
noise  is  given  in  Appendix  C. 
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We  now  investigate  for  the  M-l  changes  in  these  earlier  results 


caused  by  consideration  of  noise  which  is  spatially  correlated. 

V. 

f  t-V\o  M  _  1  T')  1  avc  ^ 

i  1 


Maximum  Likelihood  Estimation 
of  the  M-l  Delays  d.-d, 


We  again  maximize  A  by  maximizing 

,T  -1„ .  ,,T  -1, 


-  y  in  g  +  l  XI  1*V  N  V/g 
B+  B+ 


(34) 


Writing 


T  -1 
XI 


-  a  x/1,  i  x/2, ....  i  x/”> 


(35) 


and  the  m, 


th 


element 


(V*VT)  =  v 

m,n  mn 


jw(d  -d  ) 
e  m  n 


gives 


XTN~1V*VTN~1X*/g  =  -  y  I  v  (£x  NPm  yx  *Nqn) 


g  '  mn  ^  p  ^  q 
m  n  p  q  n 


-  i  y  y  v  (X  N mm  +  l  X  Npm)  (X  *Nnn  +  y  Xq  Nqn) 

cr  1  ■  L-  mn  m  #  P  n  / 

ptm  *  qrn 


g  7  L-  mn  m 
m  n 


=  i  y  y  v  (XX  *NmmNnn  +  X  N™  y  X  *Nqn 

g^^mnmn  m  h  q 


%  mn  m  n 

m  n 

lTnn 


q/n 


pm 


+  x  *  n  y  X  N 
n  P*n  P 

+  y  l  X  X  *  NpmNqn) 

p^  q^n  P  q 


(36) 


In  this  form  it  may  be  seen  that  (34)  differs  from  the  spatially  uncorrelated 

noise  case  only  in  the  -)  in  g  term  and  the  terms  in  parentheses  in  (36) 

B+ 

other  than  X  X  *  NnUnNnn.  If  p  =  0,  in  g  is  not  a  function  of  the  delays 
m  n 

and  all  NPq,  p  ^  q,  are  zero.  Then  as  the  literature  cited  shows  [3,4], 
maximization  of  (6)  reduces  to  either  a  beamformer  (choosing  M-l  d^)  or  a 
system  of  M(M-l)/2  correlators  (choosing  d^d^). 


Further  manipulation  of  Eq.  (36)  when  noise  is  diffuse  is  given  in 
App.  A  for  a  special  "worst  case"  when  all  correlations  are  real  and 

equal. 


12 


Maximizing  A  means  solving  for  in 

Ml  .  _  V  1  3g  ,  r  fl  „T  -1  3(V*VT)  -1. 
ad,  l.  g  ad, +  L{g x  N  id: — N  x 


B+  6  i  Bo¬ 


using 


and 


gi  =  3d 


T  -1  T  -1 
X  N  V*V  N  X*  3g  , 

g2  3d,'  ‘  °' 


-  2w  1  (-Re{N1^}sinu>(d  . -d  )  +  Im{NdP  }cOS-j(d.-d  )) 
i  p*i  1  p  1  p 


3(V*VT) 

3d, 


-0- 


Jiu(di-d1)  eit°(di-d2) 


in  (37)  gives 

3A 


\  -°- 

\ 

\ 

gT-  ~~1  ~  I  (Re{Nlp}sinu)(d  -d  )  +  Im{Nip}cosco(d  ,-d  )) 

ddi  B+  8  PH  1  p  1  p 


r  T  -1  -1 

+  l  X  N  AN  X* 

B+ 

where  A  =  (a  (i))  and 

mtl  /  ju)(d  -d  )  .  , 

1  I  _®ie  m  n  '8)»  ra»n  riorm  =  n  =  i 

mn  8  '  (jw  ~  gj/g)  e^^di_dn^;  m  =  i,  n  +  i 

(-jw  -  g^/g)  e  ^W^di  dm^;  m  t  i,  n  =  i 


(37) 

(38) 


(39) 


(40) 


(41) 
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Now  note  that 

xV1AN"1X*  =  J  J  a  (i)  (X  X  *NmmNnn 
'  L-  mn  m  n 

m  n 

+XNmmy  X*Nqn+X  *Nnn  V  X  Npm 
m  q  n  p*n  P 

+  l  y  X  X  *  NPmNqn)  (42) 

p*n  U  p  q 

Ignoring  the  first  summation  in  (40)  (from  the  f.n  g  term  of  A)  and  setting 

(42)  equal  to  zero  for  i  =  2,3,... ,M  constitutes  M-l  nonlinear  equations 

in  the  M-l  unknowns  d„,  d_,  ...,  d  (d  =  0). 

2  3  mi 

Equations  (42)  may  be  made  real  by  observing  that  every  (m,n)  term  has 
its  conjugate.  Thus 


+2 H  (Re{amn(i)}Re{G(m,n)} 

m  n>m 

-Im{a  (i)}lm{G(m,n) })  (43) 

mn 

where 

G(m,n)  =  l  X  NPm  J  X  *Nnq.  (44) 

p  p  q  q 

Because  the  a  (i)  are  functions  of  g.  and  g,  and  g.  and  g  are  functions  of 
ran  l  l 

all  delay  differences  d  -d  ,  the  solution  for  d.  cannot  be  found  in  terms 

p  q  i  .  ^  ^  \ 

of  X.  and  X,  alone  nor  even  as  a  linear  combination  of  the  X  X  *  eJ  p  q; 
11  P  q 

correlators . 

VI.  The  Cramer-Rao  Matrix  Bound  for  the  M-l  Delays  ^-d^. 

It  is  well  known  that  ML  estimators  approach  the  Cramer-Rao  bound 

A 

(CRMB).  The  variance  bounds  for  the  delay  estimates  d^  are  the  diagonal 
elements  in 

CRMB  «■  (FIM)-1  -  (-<  grad  (grad  A')T>)_1,  (45) 


r 
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wherein  FIM  is  the  Fisher  Information  Matrix,  grad  A'  is  a  row  vector  whose 

m^  element  is  the  derivative  of  A'  with  respect  to  the  delay  d  ^ , 

A'  is  the  expression  in  (16),  and  <*>  denotes  expectation.  The  outer  gradient 

operator  creates  a  matrix  whose  elements  are  -  1 ('§^— )  •  The  inner  partial 

k  '  i 

£ 

has  already  been  given  by  (37)  and  (40).  Continuing  we  find  with 

k 

that 

_  _L.  =  _  y  i  _fifk  ] 

9dk  (9d.>  8  H  g  1 

,  yT  -1.  92(V*VT)  fk  9(V*VT  ) 

+  X  N  1  9d,  9d  .  "  g  3d  . 

k  l  i 

.  I  !ii  V*VT  -  i  gi  W) 


+  ^2  gi8kv*VT]N~1X*} 
g  1 


If  k  i,  then 


’ik  9d 


—  =  2(i)^(Re{Nik}  cos  u)(d.-d  )  +  Im{Nik}  sin  a)(d.-d  ))  (47a) 

,  i  k.  X  K 


2  T 
)  fv*v  1 


'3d,  9d .  ’ 

k  l  m,n 


0,  (m,n)  t  (k, i)  or  (i,k) 
a)2e-^UJ(dk  di\  (m,n)  =  (k,i) 
oj2e  -^dk  di\  (m,n)  =  (i,k) 


(47b) 


These  give 


_ r~ —  )  =  y  i[g  -gg  /g] 

Od,  KddJ  ’  g  lgik  gi8k/gJ 


-y  -  xtn-1un_1x* 

U  cr 


where  u  have  the  following  values 
mn 

m  /  i,k;  n  ^  i,k 

_8ik  2gi8k  .  jw(d  -d  ) 
umn  =  (-T  +  ~7~  }  6  m  n 


(49a) 


(m,n)  a  (k.i)  or  (l,k) 


uki  =  (W 


Uik  *  Uki 


2  _  +  ffifk  +  wf*  .  !i))  e^W 


g  g 


=  k;  n  ^  i,k  or  n  =  k;  m  ^  i,k 

„  .  (-  M  +  -  !i  ju)  eJu)(W 

kn  g  g2  g 


Umk  *  Ukm 

m  -  i;  n  j  i,  k  or  n  =  i;  m  f_  i,k 

,  ('ili  +  !!i!t  .  ju) 

in  g  g2  g 

u  ,  ■  u,  * 
mi  im 


,8ik  2gi°k 

u  =  ( -  +  — - —  ) 

mm  g  g2 

Now  the  (FIM)  may  be  written  (  i  +  k) 


(FiM)ik =  Li [8^  ■  8i8k/8] 

B+ 


--<1  (|X  \20T)2 

8  B+  m  nun  m 

+2  Re{X  iT  J  X  *Nmq} 

m  q*n  q 

+Y  l  X  X  *  NPVq) 

pj^m  q^m  P  q 

+2  7  Y  (Re(u  }  Re{G(m,n) I 

m  n>m 

-Im{u  }lm{G(m,n) }) ] > 
mn 

where  G(m,n)  =  \  X  Npm  \  X  *N  ^  as 
P  P 


(49b) 


(49c) 


(49d) 


(49e) 
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Writing  all  XpXq*  as  in  (<29  )  gives 


rSe 


jO)(dp-dq)^  Npq,  p  *  q 


and 


<X  X  *>  *  { 

p  q  ls  +  N  ,  p  =  q 

<Re{G(m,n)}>  =  l  l  (Re{NpmNnql (S  costo(d  -d  )  +  Re{>?  } 
p  q  P  q  Pq 

-Im{NpmNnq}  (-S  sinu)(d  -d  )  +  Im{N#  })) 

p  q  pq 

<Im{G(m,n)}>  =H  (Re{NpmNnq  }(-S  sinw(d  -d  )  +  Im{N*  }) 

p  q  p  q  pq 

+  Im{NPmNnq}(S  cosco(d  -d  )  +  Re{N  })) 

p  q  pq 


l  l  NPmNmq  <X  X  *> 
p^m  q/m  P  q 

=  2  l  l  [Re(NpmNniq}(S  cosui(d  -d  )  +  Re{N*  }) 


p^m  q>p  ,  ^ 


m 


p  q 


pq 


-Ira{NpTndmq}  (-S  sinu(d  -d  )  +  In{NT  }) 

p  q  pq 


+  l  (  |  NPm  |  2  (S  +  N  ) 

p^m 


giving 


<F1M)ik  -  I  i  (gIk  -  8A/g) 

B  i 

-K  <  l  “,J<S+V<N'">2 

B »  m 

+  2  J  (Re{NmraNmq}  (S  cosu)(d  -d  )  +  Re(N*  } 
q?*m  m  q  mq 

-lm{NmmNmq}  (-S  sinw(d  -d  )  +  Im{N*  })) 

m  q  mq 

+  2  l  l  (Re{NpmNmq}  (S  cosw(d  -d  )  +  Re{N*  }) 

p^m  q>p»?%  p  q  pq 

-Im{NPmNmq}  (-S  sinw(d  -d  )  +  Im{N*  })) 


(51) 


(52) 


(53) 


(3’0 


+  l  i NPm |  2  (S  +  N  )] 

p/m 

+  2  £  £  [Re{u  }  <  Re{G(m,n)}> 

x  mn 

m  n>m 

-Im(u  }  <  Im{G(m,n) }  >]} 
mn 


(55) 
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For  the  diagonals  of  the  FIM,  let 


k  =  i,  then 


r1  =  g  .  =  -2ui2  l  (Re{Nlp}cosw(d  -d  ) 

kk=i  1  P 

-Im{Nlp}  sinu)(d  -d  )) 
i  p 


32(V*VT)  2 

-  2  =  -u)  I 


ejw(drdi) 

e^W  -0- 


iu)(d,-d.  ) 


J“(d -d  )  u2'  *  eJUJ(d._d  ) 

ij.  •  •  •  u  •  t  .  i 


These  give 


“°~ 


~^~2  -  l  j  Ug.,  -  g.2/g]  -  xtn'1wn"1x*} 

3diZ  B+  8  11  1 

where  wmn  have  the  following  values. 
m^i.n^i,  m^n 

„  -(  „  /„■>  Jw(d  -d  )  ,  ,,  2.  2.  ju)(d  -d  ) 

wmn  e  m  n  +  2 (g±  /g  )  eJ  m  n 

m=i,  n^iorn=  i.m^i 


(59a) 


w1n  ~  (~u2  ~  8^/g  +  2  g  2/g2  -  2  (g .  /  g)  ju))  e^di~dn^ 


w  =  w ,  * 
mn  im 


(59b) 


Wmm  "  "  8ii/g  +  2  gi2/g2 


(59c) 


Using  the  above  results  gives 

(™>u  ■  L  i  (8u  -  h2/*> 


1 


18 


-  -  l  {  l  w  [(S+N,)  (N™11)2 
g  B+  m  n“n  1 

+  2Nmm  £  ((S  coso)(d  -d  )  +  Re{N  ))Re{Nmq} 

qrtn  m  q  mq 

-(-S  sinu(d  -d  )  +  Im  {N*  })  Im{Nmq}) 
m  q  mq 

+  2  £  I  (S  cosui(d  -d  )  +  Re{N*  })  Re{NPmNmq} 
p^m  q>p,5tm  P  q  Pq 

-(-S  sinoi(d  -d  )  +  Im{N*  })  Im{NPmNmq}) 

2  P  q  P3 

+  I  |NPm|  (S  +  N  )] 
ptm  1 

+  2  £  £  [Re{w  }  <  Re{G(m,n)}  > 

ra  n>m 

-Im{wmn}  <  Im  {G(m,n) }  >]}  (60) 

To  compare  with  previous  results  observe  in  (55)  and  (60)  that  if  noise 

is  spatially  uncorrelated,  g.  =0,  and  only  u..  =  u*  =  ui2  e'^^i  dk?  and 

l  ik  ki 

*  2  ±iuj(d  -d  ) 

win  -  w  =  -oi  e  in  are  non-zero.  Further,  in  (52)  and  (53)  p  =  m 

and  q  =  n  are  the  only  non-zero  terms.  Utilizing  the  above, 

2 

v  co  xi  kk 

(FIM),,  =  -2  1  —  (cosoi(d  -d  )  N  N  S  cosco(d.-d) 

ik  B+  h  IK  IK 

i  i  kk 

+  sinui(d.-d  )  N  N  S  sinco(d  ,-d,  )) 

X  K.  X  K 

2 

r  CO  ii  kkc 
=-2  L  —  N  N  S, 

B+  s 

where  g  -  ~  +  £  N11, 
b  i 


and  similarly 

(FIM)ii 


2 

v  v  o)  „ii.,nn  _ 

2L  )  —  N  N  S. 

B+  n/ig 


It  is  readily  seen  that  this  FIM  is  identical  to  Eq.  7  (the  same  as  Eq.  12 

in  [3]). 

Unfortunately  the  FIM  defined  by  (55)  and  (60)  has  elements  which  are 
in  general  functions  of  the  delays  themselves,  making  analysis  difficult. 
However,  in  the  next  section  we  will  assume  a  signal  source  at  infinity, 
allowing  some  simplification. 
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VII.  Evaluation  of  the  CRMB 

It  is  unreasonable  to  evaluate  and  invert  the  FIM  in  sections  IV  or 
VI  in  general  because  it  is  a  function  of  all  d^.  However,  if  wavefront 
curvature  is  ignored,  each  delay  may  be  written  di  =  i&  where  A  is  the 
delay  between  adjacent  sensors.  We  may  also  let  A  vary  between  zero  and 
wA  =  it  for  a  single  frequency.  Then  d^  -  d^  =  (p-q)A  for  example.  This 
is  the  beam  former  case. 

Because  of  the  generality  of  the  formulas  we  may  also  vary  the  elements 
of  N,  using  the  symmetric  matrix  (as  in  [11]) 

/ 1  P1  P2  Pm-1  \ 


N  =  N, 


1  P!  Pm-2 


1  ... 


! 


— rO  ittlB  ^ 

wherein  p  =  pq  e  e  .  Such  a  correlation  is  appropriate  for  turbulent 
boundary  layer  noises  and  its  magnitude  with  respect  to  the  unity  diagonal 
accounts  for  isotropic  noise.  In  the  following  simulations  we  choose  |p_|  = 
0,  0.2,  0.4  and  wg  having  values  0  through  tt/2. 

Figures  1-24  show  the  CRMB  (1,1)  element,  center  element,  or  last 
element  as  a  function  of  the  various  parameters.  Table  I  is  presented  as 
a  guide  to  comparisons. 

The  formulas  for  the  FIM  may  be  applied  to  arrays  with  clustered 
elements  as  well,  if  the  spacing  between  clusters  is  considered.  We  have 
done  this  in  producing  the  data  in  Figures  25  through  30.  Zero  correlation 
between  clusters  is  assumed. 

The  clustered  (or  grouped)  arrays  studied  are  as  shown  here. 

.  .  .  *■  3  sensors 

...  ...  9  sensors 

.  +■  15  sensors 


The  spacing  between  array  ends  and  ends-to-center  remains  fixed.  The 
effect  of  adding  sensors  to  the  cluster  when  spatially  correlated  noise 
is  present  can  then  be  observed. 

Comments  derived  from  the  Figures  are  as  follows 


jftiiiPl’Tf  am  ;?***!. 


Table  I.  Guide  to  Figure  Variables 
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1.  Figures  1  through  9  show  that  variance  decreases  monotonically 
with  SNR  and  that  variations  in  p  from  0  through  0.4  /45°  have 
unpredictable,  but  not  large  effects. 

2.  Figures  1  and  7  for  example  show  that  more  sensors  (from  3  to 
15)  will  reduce  the  variance  of  a  delay. 

3.  Figures  1,2  or  3,4  or  5,6  or  7,8,9  show  that  variance  bounds  for 
delays  end-to-center  will  vary  with  p  differently  than  those  for 
end-to-end,  but  not  a  lot.  Also  the  end-to-end  delays  vary 
least. 

4.  Comparing  Figs.  1  and  3  for  example  shows  that  the  effect  of  p 

on  a  delay  estimator  will  vary  with  10A  (look  angle.)  This  variance 
is  easier  to  see  in  Figures  10-24. 

5.  Figures  10-24  demonstrate  that  the  bounds  are  effected  by  look 
angle  to  a  much  larger  extent  when  p  is  increased  to  0.4.  As  much 
as  5dB  (Figs.  11,17)  is  observed  at  SNR  =  0.1. 

6.  Comparing  Figures  in  10-24  with  like  SNR  and  M  shows  that  different 
delays  are  effected  quite  differently  as  to A  varies;  i.e.  CRMB(1,1), 
(2,2),  (7,7)  or  (14,14)  all  vary  differently  with  p  and  toA. 

7.  Grouping  sensors  when  spatial  noise  correlation  is  present  has 
a  detrimental  effect  at  low  SNR.  This  may  be  seen  in  Figures 

25,  26,  which  also  show  that  the  midpoint  and  end  delay  variances 
are  equal  at  in)A  =  0.  (They  are  not  equal  at  other  toA  per  comment 
4  above).  The  difference  between  curves  A  and  B  is  that  the  9x9 
noise  covariance  matrix  for  curve  B  has  3x3  blocks  on  the 
diagonal  while  curve  A's  noise  matrix  is  full.  Thus  curve  A 
represents  a  cluster  of  nine  sensors  while  curve  B  assumes  each 
cluster  of  3  has  noise  independent  from  the  other  clusters.  For 
p  ■  0.2  and  toA  =  0  the  effect  is  0.3  dB  at  SNR  =  0.1. 

8.  Pursuing  the  question  of  how  much  clustering  is  effective  when 
spatial  noise  is  present,  Figures  27  through  30  plot  the  variance 
bounds  vs  sensor  number  M  while  holding  array  length  constant. 

We  conclude  that  delay  variances  are  reduced  much  less  for  M 
changing  from  9  to  15  than  for  M  changing  from  3  to  9. 
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The  last  comment  is  meant  to  be  one  of  the  basic  conclusions  of  this 
study:  that  for  significant  spatially  correlated  noise,  there  is  a  point 
beyond  which  it  does  not  pay  to  increase  sensor  number  in  a  cluster  when 
the  purpose  is  to  reduce  delay  variance  between  clusters. 


vs  SNR.  M=3 .  A — p=0 ,  B — p=0. 2  ,  C— P=jO 
E — p=jO. 4 ,  F — p=0.4(l+j)  .u)A=0 


.  ■  - -  K, 


0MEGA»«2  kCRHB(L.I) 


I 


M=3. WDELTR=. 7854. NM=2 


Figure  3.  CRMB(1,1)  vs  SNR.M-3.  A--P-0,  B--p=0.2,  C— P=j0.2; 

D — p=0.4,  E — p=j0.4,  F — p=0.4(l+j)  .coA=tt/4 


0HEGR**2  *CRNBI2.2J 
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M=3.WDELTR=1.571.NM=2 


Figure  5.  CRMB(l.l)  vs  SNR.M-3.  A — P=0,  B — p=0.2,  C--P=j0.2; 
D— p-0.4,  E — p=j0.4,  F— p=0.4(l+j)  .u)A-tt/2 


M=L5,W0ELTR=0,NM=14 


Figure  7.  CRMB(1,1)  vs  SNR-M=15.  A— P=0,  B — P=0. 2 ,  C— P=j0.2; 

D — p=0.4,  E — P**j0.4,  F — p*0.4(l+j)  .u>A=0 
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Figure  15.  CRMB(2,2)  vs  wA.  11=3 .  A — p=0.0,  B — p=0.2; 
C— p=0.4.SNR=10.0 
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Figure  22.  CRHB(1,1)  vs  wA.  M=15 .  A — P=0.0,  B — P=0.2; 
C — p*0 . 4 . SNR“10 . 0 


M=9.RH0=.2.L=M-1,WD=O 


R=  LINERR  RRRHY  | 
B=  GR0UFED  RRRRY  1 


CRMB(8,8)  vs  SNR.  M=9,  p=0.2,  u) A=0.  A  —  equally 
spaced  sensors  with  full  9x9  N-matrix,  B — equally 
spaced  sensors  with  3x3  block-diagonal  N  matrix 
(cluster-independent  noise) . 
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Figure  26.  CRMB(4,4)  vs  SNR.  M-9,  P-0.2,  u)A-0.  A— equally 

spaced  sensors  with  full  9x9  N-matrix,  B— equally 
spaced  sensors  with  3x3  block-diagonal  N  matrix 
(cluster-independent  noise) . 
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Figure  27.  CRMB(1,1)  vs  M.  SNR-1.0.  A--p=0.0,  B--p-0.2, 

C — p-0.4.  Equally  spaced  sensors,  full  N-matrix. 
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Figure  28.  CRMB(1,1)  vs  M.  p-0.2.  A--SNR=0.1,  B — SNR=1 . 0, 

C — SNR=10.0.  Equally  spaced  sensors,  full  N  matrix. 
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Figure  30.  CRMB(M-l.M-l)  vs  M.  SNR=1.0.  A — p=0.0,  B—P-0.2, 

C — p®0.4.  M  sensors  have  constant  array  length; 
clusters  of  1,  3,  and  5  elements  at  center  and  ends 
of  array.  No  noise  correlation  between  clusters. 
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VIII.  Conclusions 

Although  a  closed-form  solution  for  the  ML  estimate  of  the  d  ^  has  not 
been  obtained,  nonlinear  equations  which  theoretically  may  be  solved  are 
derived.  These  show  considerable  complexity  which  might  be  somewhat 
reduced  under  rather  confining  conditions.  No  simple  hardware  analogy  is 
apparent. 

The  fact  that  the  ML  estimators  of  the  d.,  are  functions  of  all  the 

lk 

other  delays  may  be  a  positive  observation,  that  is,  no  one  delay  is  estimated 
without  consideration  of  the  others.  However,  it  has  been  shown  (at  least 
for  uncorrelated  noises)  by  Schultheiss  [5]  that  M-l  delays  are  sufficient 
in  practicality  except  when  all  sensors  have  small  SNR.  In  fact  the  CRMB 
may  not  be  found  from  (FIM)  using  the  formulas  given  herein  unless  an 
independent  set  of  d  is  used. 

The  variances  computed  for  the  delays  d^  show  considerable  -  several 
dB  -  deviation  as  p  varies  and  as  M  varies.  The  effect  is  greater  at  some 
look  angles  than  others,  and  also  depends  on  which  delay  is  considered. 

For  sufficient  spatially  correlated  noise,  clustering  sensors  is  not 
efficient  beyond  a  certain  number.  Here  we  show  6  to  9  sensors  is  a 
reasonable  number. 
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Appendix  A.  Evaluation  of  the  M(M-l)/2 
Delay  Equations  for  Dispersive  Noise 

Cron  and  Sherman  [7]  have  found  spatial  correlation  factors  as  a 
function  of  sensor  separation  distance  and  wavelength  for  diffuse  surface 
noise  and  for  diffuse  volume  noise.  If  distances  between  all  sensors 
considered  are  small  with  respect  to  half-wavelength,  the  correlations  are 
all  essentially  a  constant.  Although  long  arrays  span  much  more  than  half 
a  wavelength,  a  constant  correlation  is  useful  when  some  of  the  sensors  are 
clustered.  At  half  wavelength  the  correlation  is  zero  for  volume  noise, 
but  the  zero  location  varies  with  other  geometrical  parameters  for  surface 
noise.  Both  Cron  and  Sherman  [7]  and  Piersol  [8]  have  suggested  exploiting 
the  correlation  zero  distances  to  improve  delay  estimation;  the  implication 
being  that  the  less  correlation  the  better.  Thus  it  is  reasonable  to  assume 
a  worst  case  in  which  noise  at  any  two  sensors  has  a  maximum  correlation 
p  *  p(k).  Due  to  the  symmetry  of  the  diffuse  noise  source,  there  is  no 
time  delay  associated  with  the  correlation;  i.e.,  all  noise  cross  spectra 
are  real.  Thus  let  the  cross  spectral  matrix  for  diffuse  noise  be 


For  this  N,  use  of  the  theorem 
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p  ^  q. 
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Eq.  (19)  may  be  written 

I  {  -  g./g  +  XTN"1UN_1X*}  =  0. 
B+ 


where  the  elements  u  are  given  in  Eq.  (21),  and  g.  is  in  (20c). 

mn  l 


(A3) 


A  simplification  may  be  obtained  by  observing  the  relative  magnitude  of 
SVTN~1V*  =  sj  l  NPq  ejUXipq 

p  q 

=  S(MN1;L  +  2  l  l  NPqcoscud  ). 

p  q>p  pq 


(AA) 


Substituting  (A2)  into  (AA )  gives 
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N1(l-p)(l+(M-l)p) 


[M(l+(M-2)p) 


-2p  T  T  cor/j.'d  ] 

t  pq 

p  q>p 

Since  there  are  M(M-l)/2  terms  in  the  double  sum  and  | oos0  |  <  1, 


(A5) 


S  <  MS/Nl  <  svTn-1v*  ,  HS/Nl 
N1  1+(M-1) p  "  (1-p) (1+(M-1) p) 


[l+2( (M-3/A) 2  -  y^)p/M]  (A6> 


Thus  under  the  very  tolerable  conditions  that  MS/(N^(l+(M-l)p)>>l  or 

p«  (t; - 1)/(M-1),  we  note  that  in  (21) 
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Using  (A7)  in  (21)  gives 
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(m,n)  i  (i ,k) ,  (k,i) 


A3 


The  following  steps  will  lead  to  an  equation,  nonlinear,  for 

in  terms  of  the  other  delays  and  having  only  real  quantities.  Thus  the  d^ 

terms  are  separated  from  others  in  the  summations.  The  set  of  M(M-l)/2 
equations  could  theoretically  be  solved  for  any  M-l  independent  unknowns 
d  .  Further,  assumptions  about  large  M,  small  p,  or  small  d  ,  lead  to 

IK  IK 

simplifications  and  linearizations,  but  these  are  not  pursued  here. 


Using  the  approximations  (A8)  in  (A3)  gives 
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Grouping  index  pairs  (p,q)  according  to  matches  with  either  m  or  n  or 

both  in  e±^U)dmn  and  using  a  and  6  for  the  N_1  elements  gives  (see  Appendix  B) 

l  1  (2u)Nik  dncod.k 
B+  g 

-2pa>slimdlk  j-  £  [(2aB(|xJ2+|xl2) 

M(l-p)  (r  ,t)^(i,k) , (k,i) 

+2a2  l  l  X  X  *)  cosaxlrt; 

p^r , t ; q#r , t 

+(32  XX*  +  a2XtX  *  +  ag  l  XX  *  +  a2  J  XX^* 

q’  q 

+  a2  y  X  X  *  +  aB  I  X  X  *)ejwrt 
L ,  p  r  •  p  t 

p  P 

+  (a2X  X  *  +  32  XX*  +  a2  l  XX*  +  a B  I  XX* 
r  c  c  r  q  *  **  q 1 

+  a8  y  X  X  *  +  a2y  X  X  *)e‘Jwdrt] 

X*  P  r  P  *• 


-  «*>  (  ik  )  (2ag(|x  |Z+|x.  T)  +2 a  [  J  XX*)  coscod, 

M(l-p)  1  k  p.  q.  P  q  ik 

-  a)(2a6(|xi|2  +  |xk| 2  +  2a2  XpXq*)  sincodik 

+  co(j-2psintodi^[g2XJX,  *-H3t2x,  X.*  +  a8  J  X,X  *  +  a2  y  X,  X  * 
M(l-p)  k  k  1  q'  1  q  q’  k  q 

+  a2  l  XX*  +  a 3  y  XX.  *]eja)dik 

r.*  P  1  „«  P  * 


+  u(-i-  2psinuxiik')[a2  X.X  *  +  62X  X  *  +  a2  )  X.X  *.+  a6  V  X  X  * 
M(I-p) - '  1  k  k  1  q’  1  q  q'  k  q 

+  a8  l  XX*  +  a2  y  X  X*]e"jaxiik}  =  0  (AlO) 

p'  p  p'  P  K 


where  p'  and  q'  indicate  omission  in  their  sequences  of  r  and  t  for  the 

gJ^rt  terms  or  i  and  k  for  the  e^^ik  terms. 
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Noting  that  the  coefficients  of  e  mn  are  complex  conjugates,  we  may 
write,  using 

(a  +  jb)  (cos0+jsin0)  *  a  cos0  -  bsin0  +  j (b  cos6+asin0) 
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where  y=lifr=t,y=2  otherwise. 

Note  that  all  elements  in  Eq.  (All)  are  real  because  for  example 

l  I  XX*  -  I  |x  I2  +  2  n  Relxx*} 
p'  q'  P  q  p5^i,k  P  p*q'>p'  P  q 

First  simplifications  of  (All)  may  be  obtained  by  observing  8»|a|  when 

1  +  (M-2)p»|p|,  which  is  often  true.  The  2ajasinaxiik  term  is  negligible 

with  respect  to  any  of  the  02  or  3d  terms,  particularly  at  large  SNR.  Also 


at  large  SNR,  terms  such  as  ReiX^Xp*}  are  approximately  equal  to  S  costod^p, 

and  terms  such  as  I  (X  X  *}  are  approximately  Ssinood  .  If  2p/(M(l-p))«l, 
m  r  p  rp 

many  terms  drop  out. 


If  the  double  sum  over  r,t  could  be  omitted,  and  if  u)d^k«l,  the 
equation  could  be  linearized,  but  this  is  not  generally  feasible.  There 
are  M(M-l)/2  terms  in  the  double  sum,  each  of  comparable  magnitude  to  the 
d^k  terms,  and  the  double  sum  is  multiplied  by  2pu>  sinwd  k/(M(l-p)).  So 

roughly  to  drop  out  the  double  sum  over  r,  t,  we  require  ^  •  2^  s^nt0c*ik<<l 

M(l-p) 

or  (M-l)p/ (l-p)«l.  This  is  not  likely. 


l=0 

(All) 


B1 


Appendix  B.  Separation  of  Terms,  Diffuse  Noise 

In  Eq.  (A9) the  double  sum  over  r,t  is  broken  into  parts  for  (r,t)  j* 
(i,k),  (k,i)  and  (r,t)  *  (i,k),  (k,i).  Each  part  then  has  terms  such  as 

eja)dik  HXX  *NPlNkq  +  e-jaJdik  [[XX  Wq 
pq  Pq  pq  Pq 

wherein  r  and  t  replace  i  and  k  for  the  other  part  of  (A9 ) .  The  double  sum 
over  p,  q  may  further  be  broken  down  into  parts  for  which  p  or  q  or  both 
are  equal  to  i  or  k  or  both,  each  case  giving  different  values  for  Npi  or 
Nkq.  These  give  the  following  results,  using  B  and  a  from  (A2 )  and  e+  and 
e“  for  the  exponentials.  (Similar  results  are  obtained  for  the  difference 
of  the  conjugate  exponentials,  yielding  sinaxiik  terms). 

p.q  -  i.i 

Balx^l^  e+ +  Bajx^l^e”3  2Ba | |  2cosuxi^k 

P.q  »  fc,k 

2Ba  |xk|2coswdik 

p.q  *  i.fc 

5  *  +  2  *  - 

B  XAXk  e  +  a  X±Xk  e 

P.q  35  k,i 

2  *  +  „2  *  - 

“  Vi  *  +8  Vi  e 

p.q  *  l.q  f  l.k 

)  X.X  Ba  e  +  y  X,X  a  e 

q  i  q  L  i  q 

p,q  -  k,q  *  i,k 

p  ft  2  -t"  r*  ft  •. 

I  Vq  °  ‘  +  X  Vq  611  e 

q  q 

p.q  -  p  t  j.frq  -  1 

l  XX**2  e+  +Z  XX*  as  e" 

P  P  v 


k 


.  +  r  *  2 
a3  e  +  Y  X  X.  cr 
L  p  k 
P 


>k 


l  a2 

q^i,k 


X  X  cosuid 

p  q 


ik 


Appendix  C.  Evaluation  of  FIM  for  Diffuse  Noise, 

An  Independent  Subset  of  M(M-l)/2  Delays 

The  following  applies  to  any  subset  of  M-l  independent  delays  d.^_. 


To  determine  the  FIM,  we  must  calculate  the  expected  values  of  X  X^* 


using  the  noise  matrix  in  (Al) .  This  gives 


<X  X  *>  =  { 
r  t 


S  +  Nx  ,  r  =  t 
2  -^rt  +  pN^  r  ^  t 


We  also  note  that  (23)  becomes  for  real  N 


~  3  A"  -  -  J  (2co2gNikcosd  ,  +  4co2(Nik)2sin2ood.,  )/g2 


3dlk2  B+ 


+  XTN  1  A(m,n)N-1X*} 


The  elements  of  A(m,n)  =  (a  )  are  (using  (24)-(28)  and  real  N) 

mn 

a..  '  <i  <^4)  +  (V*VT)  +  ffivl  ) 

uwt  s  _  -  o  ~  ~ — - -  dd., 

ih  m,n  2  m,n  2  xk  m,n 

o  g 

2  ik  2  2 

8uo  (Nllt)  sin  cod ..  _ 

- 3 - —  <v*v  \  n> 

g3 


2  .cod  ,  2oj2Nikcosud  e^^ik 
-co  e  j  ik  +  _  ik _ 


4co2N*ks  incod  ,  e^^ik 
+j  _ ik 


+  8co2(Nik)2sin2(odik  eJwdik,  (m,n)  =  (i,k) 


2co2Nikcoscod,,  jcod  +  8co2(Nik)2sin2cod ..  jcod  ,  ....  ,,  .. 

_ ik  e  mn  v  ' _ ik  eJ  mn,  (m,n)f(i,k),  (k,i) 


and  a 


a  *. 
mn 


g 


T 


C2 


Now  from  (C2)  we  may  expand 
T  -1.  -1 


<X  N  AN  X*>  =  y  y  <  I  x  N™  y  a  N  X  *> 
mn  r  r  t  mn  C 

=  1111  <  \\*>  NmNntan 


m  n  r  t 


mn 


(C4) 


Applying  (Cl),  (C3)  and  (C4)  to  (C2)  and  using  the  separation-of- 
terms  process  in  Appendix  B  gives  for  the  diagonal  elements  of  the  FIM, 

2 

(FIM)  =  -  y  co2  (2acoscod  ,  +  sin^cod., 

vv  B+  g“  ik  8  lk 

2  2 

+  (-1  +  ik  +  ik  )  [4aB(S+N,  )coscod 

A  ~  J.  IK. 


g 


g 


+  2(a2+82)  pN^  cosaxlik  +  202S  +  2a2S  cos  2u)dik 
2 

+4(M-2)  pN^(a  +a0)  coscod  lk 

2  2 

+2  S  y  (agcosuKd^-d^)  +  a  cosu^d^+d^)  +  a  cosw(di^-d^) 
+  aBcosoj(dik+dk<i)) 

+  2a2((M-2)(S+N1)  +  2((M-2)2  -  (M-2))pNx 
+  2  y  y  S  cosaxlrin)cosojdik] 


p'  q'>Pf 


pq 


-  (4astn(Jjdik  )  [4aB(S-t-N1)sin0JdiU 

g  1 

+  2(a  +  B2)  pN^  sinood^k  +  2  a2  S  sin2ood^k 

+  4(M-2)  pN1(a2-Ki8)  s incod ik 

r  2  2 

+2S  I  (agcosco(dik-diq)  -  a  cosuKd^+d^)  +  a  cosco(d,.u-d]_) 


iq  ik' 


ik  kq' 


-aBcosco(dik+d(j^)) 

+  2a2 (M-2)  (S+N- )  +  2((M-2)2  -  (M-2))  PN.  +  2  y  y  coscod  )sincod,.  ] 

1  1  o’a’>n’  Pq  ik 


p  q  >p 

2  2  2  2 

4.  /2to  acoscod,.  8to  a  sin  cod.,  .  r  r  ,, 

+  ( _ iji  + _ ik)  l  2  [4a0 (S+N.) coscod 

2  (r,t)*(i,k)  1 


rt 


g 


(k,i) 


g 


+  2(a2+$2)pN1  coscodrt  +  2S2S  +  2ct2S  cos  2wdrt 
+  4(M-2)pN^(a2+a8)coscodrt 


+  2  S  V  (a0cosco(d  -d  )  +  a2cosco(d  +d  ) 

S  rt  rq  rq  rt 

2 

+  a  cosw(d  -d.  )  +  a0cosu>(d  +d  )) 
rt  tq  rt  _  rq 

+  2a2((M-2)(S+N1)  +  2((M-2)2  -  (M-2))pN1 

+  2  l  l  Scosajd  )coscod  ]}  (C5 ) 

p«  q ' >p '  Pq  rt 


Some  reduction  in  the  number  of  terms  may  be  obtained  by  gathering 
coefficients  of  sines  and  cosines,  but  this  will  not  be  done  here.  Rather 
the  various  terms  are  left  for  better  inspection  and  identification  with 
their  sources.  However,  let  it  be  observed  that  the  diagonal  elements 
(FIM)^  may  be  written 


2  ,  2 

(FIM)  =  -  7  —  {2acosU)d.,  +  sin  cod 
w  g  ik  g 

+  (-1  +  2aC°Saidik  +  8«2sin2^lk)  A  (i,k) 


ik 


g 


"  (4aS±nWlik  )  A2(i,k) 
g 


g 


,  ,2u>  acosood.. 
+  ( _ ik 


+  !ll!^ik)  j  i 


g 


(r ,t)^(i,k) ,(k,i) 


A3(r,t)} 


(C6) 


where  A^,  A2>  and  A^  are  as  indicated  in  (C5).  These  will  be  used  again  in 
the  off-diagonal  elements'  expression. 

The  off-diagonals  are  found  similarly. 


Utilizing  functions  A^,  A2>  and  A^  as  in  (C5)  and  (C4)  the 
off-diagonals  are 

2  2 

(FIM)  »  -  y  —  {4  a  sinuxL.  sinwd  /g 
vw  |+  g  ik  rt 

+  8a2sinaxirt  sinaxiik  A  (i  k) 

g2 

+  2  a  sinuid^ 


A2(i,k) 


C4 


,  8a  sin.od  si  mud,,  ,  . 

+  _ rt _ Uc  A  (r,t) 


2  a  sincud., 
+  lk 


,  8a“sini.od  sin<od..  r  c  .  ,  . 

+ _ rt _ lk  l  I  A  (m , n)  }  (c7-, 

2  (m,n)^(i,k) , (k,i) 

8  (r,t),(t,r) 

A  few  remarks  are  in  order  at  this  point.  The  obvious  feature  is  that 

expressions  (C6)  and  (C7 )  for  the  FIM  elements  are  very  complex;  they  are 

functions  not  only  of  the  delays  whose  covariance  is  sought  but  also  of 

2 

all  other  delays.  One  simplification  is  to  discard  a  and/or  a-  factor  terms 
2 

with  respect  to  3  terms.  Another  is  to  consider  the  case  where  all  delays 
are  equal  to  zero.  For  a  zero  delay  vector,  the  covariances  in  (C7)  are 
also  zero,  the  inversion  of  the  FIM  is  considerably  simplified,  and  the 
diagonal  elements  of  FIM  and  their  inverses  are  functions  of  p,M,S  and  only. 


A2(r ,t) 


It  is  interesting  that  in  this  zero-delay  situation  the  covariance 
of.  two  delays  is  zero.  This  differs  from  the  ML  estimation  of  the  M-l 
de’ays  referred  to  a  single  sensor  (see  Eq.  7).  Those  delays  have  a  non¬ 
zero  covariance  with  or  without  correlated  noise.  Mathematically  the 
difference  is  between  3  .  3v  VT  .  and  3  ,  3V  VT  .  . 


3  3V*VT  .  and  3  ,  3V*VT  ,  . 

3drt  8d2  3dl  ’ 


The  second-order  partial  with  double  subscripted  variables  is  zero,  while 

★  T 

that  with  single  subscripts  is  not.  This  is  because  the  elements  of  V  V 
are  of  the  form  exp(jw(d.-d  ))  =  exp(j(od.,).  For  example  if  d  =  d.  and 

X  iC  IK  1  i 


V  then 


*  T 

3V  V 


)  yields  an  element  to  exp(jto(d1~d2) )  /  0,  but 


’“resile 


(V  V  )  =  0.  Further,  if  p  =  0,  then  the  off-diagonal  elements  of 


the  FIM  of  the  d^  are  always  zero.  Evidently  with  spatially  uncorrelated 
noise,  ML  estimates  of  the  d^  are  uncorrelated,  although  either  the 
generalized  cross-correlator  measurements  of  d  ^  which  yield  ML  estimates 
of  the  dj  [3,4]  or  the  ML  estimates  of  the  M-l  delays  d^  are  correlated, 
as  shown  in  Eqs.  (13)  and  (7). 
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